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Introduction. Ising like models on complete, but small graphs are often considered for exper- 
iments in papers on new or improved methods for estimating marginal probabilities of random 
fields [|6l|7l[5l|2l[3l. This note aims to draw attention to the fact that the partition function and 
marginal probabilities can be computed in polynomial time for a certain class of random fields 
on complete graphs. This class includes Ising models with homogeneous pairwise potentials 
but arbitrary (inhomogeneous) unary potentials. Similarly, the partition function and marginal 
probabilities can be computed for random fields on complete bipartite graphs provided they 
have homogeneous pairwise potentials. 

The model class; computing the partition function. Let us consider the following class of 
binary valued random fields on complete graphs 

(1) p(x) = -~ IJ g(x» Xj) Yl Qi( x i), 

where (V, E) denote the sets of vertices and edges of a complete graph and x : V — > {0, 1} 
is a binary valued labelling of the vertices. Notice, that we assume that g: {0, l} 2 — > R is 
shared by all pairwise factors. Given the model parameters g and the task is to compute the 
partition sum 

(2) Z = ^2 II 9(xi, Xj) JJ qi(xi) 

xGX ijeE i£V 

as well as unary and pairwise marginal probabilities p(xi) and p(xi, Xj). We assume without 
loss of generality that g has the form 



(3) g(k, k') 
and the unary factors have the form 

(4) q t (k) - 



a if k 7^ k', 
1 otherwise, 



ft iffc = 0, 
1 otherwise. 



This can be achieved by applying an appropriate re-parametrisation without changing the prob- 
ability. 

In order to calculate the partition sum Z for a graph with n vertices, we partition the set 
X = {0, l} n , of all labellings into the sets Xq, X\, . . . , X n , where X m denotes the set of all 

l 
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labellings with m vertices labelled by "1" 

(5) X m = |x E X | E] Xi = ?Ti|. 

Accordingly, we denote the partial sums by 

(6) z m =^2 n g( x h x j) n*^')- 

Due to the homogeneity assumption Q, the pairwise factors in (|6]) contribute to each summand 
of Z m by the same factor a m ( n - m )_ Hence, we may write 

n n 

(7) Z = Z ™ = E « m(n_m) ^v(^), 

m=0 m=0 

where 

(8) H v (m) = e n^(^) = e iw^ 

denotes the sum of all unary contributions to the partial sum Z m . These quantities can be 
computed recursively over the size of the graph. Let us denote by Hu{m), m = 0,1, . . . ,\U\, 
the corresponding quantities for the complete sub-graph induced by the vertex set U C V. If 
i E U is a vertex of this graph, then obviously, 

(9) Hu(m) = ^ H uv (m) + H uV (m - 1). 

This results in an algorithm for computing Z with 0(n 2 ) time complexity. 

It is similarly easy to compute marginal probabilities because the mapping defined by (|9]) is 
invertible. In order to compute e.g. the unary marginal probabilities for the vertex i E V 

n 

(10) p( Xl = 1) = E H vv(m - l)a m{ - n -^ 



m=l 
n-1 



(11) p(x l = 0) = E^' 



m=0 



we need the quantities ifyw(m), which can be computed from those for the whole graph with 
0(n) time complexity by 

(12) H vv (m) = i \H v {m) - H vv (m - 1) 

Pi L 

This results in a 0(n 2 ) algorithm for calculating the unary marginals for all vertices of the 
graph. 

The proposed approach can be generalised to i^-valued random fields on complete graphs 
with homogeneous pairwise interactions. For this we partition the set of all labellings X into 
sets X m , where m = (mi, . . . , m^) is a vector, the components of which denote the number 
of variables taking the respective label value, i.e, 

(13) X m = ja; E X | E^' 1 ) = mi > • • • > E^^ Xi '^ = niK ] 
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The corresponding contributions H v (m) of all unary terms to the partial sums can be again 
computed recursively by 



A 



(14) H u (m) = ^2q i (k)H V \ i (m.-e k ), 

k=l 

where ek denotes the standard basis vector for the component k. This leads to the following 
theorem. 

Theorem 1. Given a K -valued random field on a complete graph with homogeneous pairwise 
factors and arbitrary (inhomogeneous) unary factors. Its partition sum can be computed with 
0{n K ) time complexity. 

Remark 1. Note, that the theorem is not in contradiction with the dichotomy found by Bulatov 
and Grohe [1J because here we restrict the graph structure. 

Models on complete bipartite graphs. The applicability of the proposed approach can be 
extended even further, e.g. for the calculation of the partition function and marginal probabili- 
ties for random fields defined on complete bipartite graphs. Here, again, it is required that the 
pairwise interactions are homogeneous. We will consider binary valued random fields for the 
sake of simplicity. 

Let G{V, E) be a complete bipartite graph and V\, Vi denote its parts (n\ = |Vi|,n 2 = | V2 1 ) . 
Consider the class of binary valued random fields x : V — > {0, 1} 

(15) p(x) = - Yl 9{xi, Xj) Yl Qi{xi). 

ieVi iev 

As discussed in the previous section, we may assume that the factors g, qi have the form (|3]) 
and Q respectively. 

In order to compute Z, we partition the set of all labellings X into the sets 

(16) X m — |x G X J Xi = mi , Xj = m 2 

ieVi jev 2 

where m = (mi, m 2 ) counts the number of vertices labelled by "1" in the first and second 
part, respectively. It is clear that the pairwise factors contribute to all summands of Z m by 
the same factor a K , where k = mi(n 2 — m 2 ) + (rii — mi)m 2 . Hence, as before, the problem 
reduces to the computation of the contributions Hv 1 y 2 (m) of the unary factors. They can be 
computed recursively over the graph size. Similar to ([9]) we have here 

(17) H UuU2 (m) = (3i ■ Hu^u^m) + H Vl \i tUll (m - ei), 

(18) H UuU2 (m) = /3j ■ H UuUa \j(m) + H UuUa \j{m - e 2 ). 

This results in a 0(nfn|) algorithm for computing the partition sum Z. Generalising this to 
if-valued labellings as in the previous section we get the following result. 

Theorem 2. Given a K -valued random field on a complete bipartite graph with homogeneous 
pairwise factors and arbitrary (inhomogeneous) unary factors ( fT5| ). Its partition sum can be 
computed with O^nfnf) time complexity. 
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Conclusion. We have shown that the partition sum and marginal probabilities can be effi- 
ciently computed for random fields on complete graphs if they have homogeneous pairwise 
factors. Similarly, the partition sum and marginal probabilities can be efficiently computed for 
random fields on complete bipartite graphs provided they have homogeneous pairwise factors. 
We do not expect these two model classes to be directly relevant for computer vision applica- 
tions. We expect, however, that they can be very useful to evaluate approximation algorithms 
for computing marginal probabilities. To the best of our knowledge they are the only so far 
known classes of large scale random fields defined on graphs with large tree- width and with 
arbitrary unary factors^ for which the marginal probabilities can be computed in polynomial 
time, thus providing exact error estimates for approximation algorithms. 
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'The method presented in [4] requires outer-planar graphs, i.e. tree-width two, if applied for the case of 
arbitrary unary factors. 



